Information processing apparatus, information processing method, and program

ABSTRACT

There is provided an information processing apparatus, an information processing method, and a program capable of performing synthesis that is desirable for users as described above, the information processing apparatus including: a control unit configured to generate a synthesized object model by synthesizing a first object model and a second object model, and cause the generated synthesized object model to be displayed in association with an image corresponding to the first object model or the second object model. The control unit controls a mode of the synthesis on the basis of input information.

TECHNICAL FIELD

The present disclosure relates to an information processing apparatus,an information processing method, and a program.

BACKGROUND ART

In recent years, technologies of superimposing and displaying images onvirtual or real images have been studied and developed with progress inimage processing technologies. There is also an augmented reality (AR)technology, for example, as one of such technologies, and the technologyhas been applied to various fields.

For example, Patent Literature 1 discloses an information processingapparatus that superimposes and displays a make-up image, which tracks aface in an image, on the image on the basis of positions of parts of theface recognized in the image. Various images can also be superimposedand displayed instead of the make-up image. Specifically, a synthesizedimage obtained by synthesizing two or more images is included.

CITATION LIST Patent Literature

-   Patent Literature 1: JP 2012-181688A

DISCLOSURE OF INVENTION Technical Problem

However, the synthesis of the images in the technology in the relatedart is fixed and does not always suit intentions of users. Thus, thepresent disclosure will propose a novel and improved informationprocessing apparatus, information processing method, and program capableof performing synthesis that is desirable for users.

Solution to Problem

According to the present disclosure, there is provided an informationprocessing apparatus including: a control unit configured to generate asynthesized object model by synthesizing a first object model and asecond object model, and cause the generated synthesized object model tobe displayed in association with an image corresponding to the firstobject model or the second object model. The control unit controls amode of the synthesis on the basis of input information.

In addition, according to the present disclosure, there is provided aninformation processing method including: by a control unit, generating asynthesized object model by synthesizing a first object model and asecond object model; causing the generated synthesized object model tobe displayed in association with an image corresponding to the firstobject model or the second object model; and controlling a mode of thesynthesis on the basis of input information.

In addition, according to the present disclosure, there is provided aprogram that causes a computer to realize: a function of generating asynthesized object model by synthesizing a first object model and asecond object model; a function of causing the generated synthesizedobject model to be displayed in association with an image correspondingto the first object model or the second object model; and a function ofcontrolling a mode of the synthesis on the basis of input information.

Advantageous Effects of Invention

According to the present disclosure, it is possible to provide aninformation processing apparatus, an information processing method, anda program capable of performing synthesis that is desirable for users asdescribed above. Note that the effects described above are notnecessarily limitative. With or in the place of the above effects, theremay be achieved any one of the effects described in this specificationor other effects that may be grasped from this specification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing a schematic functional configurationexample of an information processing apparatus according to a firstembodiment of the present disclosure.

FIG. 2 is a diagram illustrating image synthesis processing according tothe embodiment.

FIG. 3 is a diagram showing a combination example of src and dstaccording to the embodiment.

FIG. 4 is a diagram illustrating operations and processing related to asynthesized face mask according to the embodiment.

FIG. 5 is a diagram showing an example of a face mask that is displayedby the information processing apparatus according to the embodiment.

FIG. 6 is a flowchart conceptually showing processing that is performedby the information processing apparatus according to the embodiment.

FIG. 7 is a diagram illustrating processing of generating a plurality ofsynthesized face masks based on a face mask or the like selected in aface list according to a second modification example of the embodiment.

FIG. 8 is a diagram illustrating processing of generating a plurality ofsynthesized face masks based on a face mask selected from face imagesand the like that are displayed on a screen according to the secondmodification example of the embodiment.

FIG. 9 is a diagram illustrating registration processing in a face listaccording to a third modification example of the embodiment.

FIG. 10 is a diagram illustrating synthesis processing according to afourth modification example of the embodiment.

FIG. 11 is a diagram illustrating a preview in a face list according toa fifth modification example of the embodiment.

FIG. 12 is a diagram illustrating synthesis processing in a case inwhich no face mask is secured according to a sixth modification exampleof the embodiment.

FIG. 13 is a diagram illustrating synthesis processing in a case inwhich a face mask is secured according to the sixth modification exampleof the embodiment.

FIG. 14 is a diagram showing an example of an interface for adjustingface feature information in a synthesized face mask according to aseventh modification example of the embodiment.

FIG. 15A is a diagram illustrating processing of changing meshinformation in the synthesized face mask according to the seventhmodification example of the embodiment.

FIG. 15B is a diagram illustrating processing of changing meshinformation in the synthesized face mask according to the seventhmodification example of the embodiment.

FIG. 15C is a diagram illustrating processing of changing meshinformation in the synthesized face mask according to the seventhmodification example of the embodiment.

FIG. 16 is a diagram illustrating another example of the processing ofchanging the mesh information in the synthesized face mask according tothe seventh modification example of the embodiment.

FIG. 17 is a diagram illustrating processing of changing textureinformation in the synthesized face mask according to the seventhmodification example of the embodiment.

FIG. 18 is a diagram illustrating processing of changing textureinformation in the synthesized face mask according to the seventhmodification example of the embodiment.

FIG. 19 is a diagram showing an example of processing of synthesizing anobject other than a face according to a ninth modification example ofthe embodiment.

FIG. 20 is a diagram showing another example of processing ofsynthesizing an object other than a face according to the ninthmodification example of the embodiment.

FIG. 21 is a diagram illustrating operations for moving a face mask as atarget of synthesis, which are performed by an information processingapparatus according to a second embodiment of the present disclosure.

FIG. 22 is a diagram illustrating processing of assigning a target ofsynthesis based on movement of a user, which is performed by theinformation processing apparatus according to the embodiment.

FIG. 23 is a diagram illustrating an example in which a face mask or thelike that is a target of synthesis is moved by a character according toa first modification example of the embodiment.

FIG. 24 is a diagram illustrating generation and sharing of linkinformation according to a second modification example of theembodiment.

FIG. 25 is an explanatory diagram showing a hardware configuration of aninformation processing apparatus according to an embodiment of thepresent disclosure.

MODE(S) FOR CARRYING OUT THE INVENTION

Hereinafter, (a) preferred embodiment(s) of the present disclosure willbe described in detail with reference to the appended drawings. In thisspecification and the appended drawings, structural elements that havesubstantially the same function and structure are denoted with the samereference numerals, and repeated explanation of these structuralelements is omitted.

In the specification and the drawings, a plurality of components withsubstantially the same functional configurations will be distinguishedwith different numbers added to the same reference numerals in somecases. For example, a plurality of configurations with substantially thesame function will be distinguished as a face mask 20A and a face mask20B, for example, as needed. However, only the same reference numeralswill be given in a case in which it is not necessary to distinguishsubstantially the same functional configurations. In a case in which itis not particularly necessary to distinguish the face mask 20A and theface mask 20B, the face masks will be simply referred to as face masks20.

Description will be given in the following order.

1. First embodiment (application example to mobile terminal)1-1. Configuration of apparatus1-2. Technical features of apparatus1-3. Processing by apparatus1-4. Summary of first embodiment1-5. Modification examples2. Second embodiment (application example to digital signage apparatus)2-1. Configuration of apparatus2-2. Technical features of apparatus2-3. Processing by apparatus2-4. Summary of first embodiment2-5. Modification examples3. Application examples4. Hardware configuration of information processing apparatus accordingto one embodiment of present disclosure

5. Conclusion 1. First Embodiment (Application Example to MobileTerminal)

First, an information processing apparatus 100-1 according to a firstembodiment of the present disclosure will be described. The informationprocessing apparatus 100-1 according to the embodiment is a portablemobile terminal such as a smartphone or a tablet terminal. Informationprocessing apparatuses 100 according to the first and second embodimentswill be distinguished by adding numbers corresponding to the embodimentsat the ends, such as an information processing apparatus 100-1 and aninformation processing apparatus 100-2 for convenience of description.

1-1. Configuration of Apparatus

A functional configuration of the information processing apparatus 100-1according to the first embodiment of the present disclosure will bedescribed with reference to FIG. 1. FIG. 1 is a block diagram showing aschematic functional configuration example of the information processingapparatus 100-1 according to the first embodiment of the presentdisclosure.

The information processing apparatus 100-1 includes an imaging unit 102,a face recognition unit 104, an operation detection unit 106, a controlunit 108, a storage unit 110, and a display unit 112 as shown in FIG. 1.

The imaging unit 102 images the surroundings of the informationprocessing apparatus 100-1. Specifically, the imaging unit 102 capturesa stationary image or a moving image on the basis of an instruction fromthe control unit 108. For example, the imaging unit 102 can include animaging optical system such as an imaging lens for collecting light anda zoom lens and a signal conversion element such as a charge coupleddevice (CCD) and a complementary metal oxide semiconductor (CMOS). Aninput unit that obtains images may be included instead of the imagingunit 102. The images may be acquired via communication.

The face recognition unit 104 recognizes a face included in an image asan object (including a part of an object). Specifically, the facerecognition unit 104 recognizes a face appearing in an image obtainedthrough image capturing by the imaging unit 102 or a face included in animage that is stored in the storage unit 110. Then, a face recognitionresult is provided to the control unit 108. For example, the facerecognition unit 104 performs face recognition processing by using atypical face recognition technology.

The operation detection unit 106 detects a user's operation performed onthe information processing apparatus 100-1. Specifically, if a userperforms an operation, the operation detection unit 106 acquiresinformation related to the operation, and detects content of theoperation from the acquired information related to the operation. Then,an operation detection result is provided to the control unit 108. Forexample, the operation detected can be a button operation, a clickingoperation, a tapping operation, a dragging and dropping operation, aswiping operation, a flicking operation, a gesture operation, or thelike.

The control unit 108 controls image display. Specifically, the controlunit 108 performs image synthesis processing on the basis of the facerecognition result by the face recognition unit 104 and the operationdetection result detected by the operation detection unit 106.Furthermore, image synthesis processing will be described in detail withreference to FIG. 2. FIG. 2 is a diagram illustrating processing ofsynthesizing an image according to the embodiment.

First, the control unit 108 detects feature points in the recognizedface. For example, the control unit 108 detects the feature points asshown in the center left diagrams in FIG. 2 in images (hereinafter, alsoreferred to as face images) 10A and 10B of a face recognized by the facerecognition unit 104 as shown in the left diagrams in FIG. 2.

Next, the control unit 108 generates face models (hereinafter, alsoreferred to as face masks) on the basis of the detected feature points.Specifically, the control unit 108 generates information (hereinafter,also referred to as face feature information) including mesh informationand texture information on the basis of the feature points. Then, thecontrol unit 108 generates face masks on the basis of the face featureinformation. For example, the control unit 108 generates the meshinformation related to a mesh as shown in the center right diagrams inFIG. 2 on the basis of the feature points and generates textureinformation related to a texture in regions sectioned by the mesh. Then,the control unit 108 respectively generates the face masks 20A and 20Bas shown in the right center diagram in FIG. 2 on the basis of the meshinformation and the texture information for each of the face images 10Aand 10B.

Next, the control unit 108 generates a synthesized face mask bysynthesizing the face masks. Specifically, the control unit 108 combinesthe face feature information of the respective face masks and generatesthe synthesized face mask on the basis of the face feature informationobtained by the combination. For example, the control unit 108 generatesthe face feature information including the mesh information of the facemask 20A and the texture information of the face mask 20B as shown inthe right center diagram in FIG. 2 and generates the synthesized facemask on the basis of the face feature information.

Next, the control unit 108 causes the generated synthesized face mask tobe displayed in association with an image corresponding to a face maskthat serves as a synthesis destination or a synthesis source(hereinafter, also referred to as a target of synthesis). For example,the control unit 108 causes the generated synthesized face mask 30 to besuperimposed and displayed on a face image 10A corresponding to the facemask 20A as shown in the right diagram in FIG. 2.

Returning to the description of the functional configuration of theinformation processing apparatus 100-1 with reference to FIG. 1, thestorage unit 110 stores information related to image processing.Specifically, the storage unit 110 stores an image as an input to theface recognition processing and dictionary information (feature pointinformation) for face recognition.

The display unit 112 displays an image. Specifically, the display unit112 displays an image provided from the control unit 108. For example,the display unit 112 can be a liquid crystal panel, an organicelectroluminescence (EL) display, or the like.

1-2. Technical Features of Apparatus

Next, technical features of the information processing apparatus 100-1according to the embodiment will be described.

(A. Assignment of Target of Synthesis)

The information processing apparatus 100-1 assigns a target of synthesisin response to a user's input. Specifically, the control unit 108assigns as a target of synthesis a face mask specified on the basis of auser's input operation or a face mask generated from a specified faceimage. The assignment of the target of synthesis is assignment of asynthesis source (src) and a synthesis destination (dst). Furthermore,combinations of src and dst will be described with reference to FIG. 3.FIG. 3 is a diagram showing an example of combinations of src and dstaccording to the embodiment.

First, there are mainly three types of face images corresponding to aface mask that serves as a target of synthesis. For example, the faceimage can be a stationary image, a moving image, or an image that istemporarily recorded by image capturing (hereinafter, also referred toas a through image). The control unit 108 synthesizes a face maskgenerated from a face image that is a stationary image, a moving image,or a through image and a face mask generated from a face image that is astationary image, a moving image, or a through image. Therefore, ninesynthesis patterns are present as shown in FIG. 3, for example. Inaddition, src or dst may be face masks that have already been generated,and sixteen synthesis patterns are present if this case is included.

There are some timings at which the face masks are generated.Specifically, the face masks are generated before the synthesisprocessing or when the synthesis processing is started. Examples oftimings before the synthesis processing include time at which the facerecognition unit 104 recognizes a face. Examples of the time when thesynthesis processing is started include time when movement of the facemasks, which will be described later, is started or time when theassignment of the target of synthesis, which is not accompanied by themovement of the face masks, is completed.

The control unit 108 causes the face mask, which is the target ofsynthesis to be moved in response to an input based on user's motion.Specifically, the input based on the user's motion includes an operationfor assigning both a start point and an end point or an operation forassigning only a start point. There is a dragging and dropping operationas the operation for assigning both the start point and the end point.There is a swiping operation or a flicking operation as the operation ofassigning only the start pint. For example, the control unit 108 assignsas sec a face mask or a face image (hereinafter, also referred to as aface mask or the like) as a target of the dragging operation and assignsas dst a face mask or the like as a target of the dropping operation.Alternatively, the control unit 108 assigns as src a face mask or thelike on which the swiping operation or the flicking operation has beenperformed on and assigns as dst a face mask or the like that ispositioned in a direction of the swiping operation or the flickingoperation. The face mask or the like on which the swiping operation orthe flicking operation has been performed is moved as if it flew towardthe direction of the operation.

(A-1. Assignment of Synthesis Source)

The control unit 108 assigns as src a face mask that is selected by auser's input operation or a face mask that is generated from a selectedface image. Specifically, the control unit 108 causes a face list, inwhich face masks or face images are lined up, to be displayed on ascreen. Then, the control unit 108 assigns as src a face mask that isselected from the face list by a user's input operation or a face maskthat is generated from a selected face image. For example, the controlunit 108 assigns as src a face mask that is selected as a target ofmovement. Furthermore, processing of assigning a synthesis source willbe described in detail with reference to FIG. 4. FIG. 4 is a diagramillustrating operations and processing related to a synthesized facemask according to the embodiment.

The control unit 108 causes the face list, in which face masks or faceimages are lined up, to be displayed on the screen. For example, thecontrol unit 108 causes a face list, in which stationary face images12A1 to 12A3 as shown in the lower portion in FIG. 4 are lined up, to bedisplayed on the screen.

Then, the control unit 108 assigns as src a face mask that is specifiedby an user's input operation from the face list or a face mask that isgenerated from a specified face image. For example, the control unit 108assigns as src the stationary face image 12A1 as a target of thedragging operation as shown in the left diagram in FIG. 4.

Although the example in which src is selected from the face list hasbeen described hitherto, src may be selected from a stationary image, amoving image, or a through image displayed on the screen. For example,the control unit 108 assigns as src a face mask or the like that isselected by the user from a face image included in the face recognitionresult obtained from the stationary image, the moving image, or thethrough image displayed on the screen or from a face mask that isgenerated from the face image.

The control unit 108 selects a face mask or the like lined up in theface list on the basis of attributes of a face expressed by a face maskas a candidate of synthesis. Specifically, the attributes of the faceinclude an age or a sex. For example, the control unit 108 selects aface mask or a face image corresponding to the face mask of a an agethat is close to an age estimated from the face of the face imageprovided as a face recognition result from the face recognition unit 104or that expresses a face of the same sex as an estimated sex. Then, thecontrol unit 108 causes the face list, in which the selected face maskor the like is lined up, to be displayed.

The face mask or the like lined up in the face list may be a face maskor the like for a face recognized in a predetermined period of time.

(A-2. Assignment of Synthesis Destination)

The control unit 108 assigns as dst a face mask that is selected by auser's input operation or a face mask that is generated from a selectedface image. Specifically, the control unit 108 assigns as dst a facemask or the like at a movement destination, such as a face mask or thelike to be moved. Furthermore, processing of assigning the synthesisdestination will be described in detail with reference to FIG. 4.

The control unit 108 causes the face mask or the like assigned as src tobe moved in response to an input based on user's motion. For example,the control unit 108 causes a stationary face image 12A1 assigned as atarget of a dragging operation as shown in the left diagram in FIG. 4 tobe moved in accordance with user's finger motion.

Next, the control unit 108 assigns as dst a face mask or the like thatis present at a position at which an input ends when the input based onuser's motion ends. For example, if the stationary face image 12A1 ismoved toward a through face image 16A, and a dropping operation isperformed on the face image 16 as shown in the left drawing in FIG. 4,the control unit 108 assigns the face image 16A as dst.

(B. Generation of Synthesized Face Mask Based on Synthesis Mode)

The information processing apparatus 100-1 generates a synthesized facemask in accordance with a mode for synthesis (hereinafter, also referredto as a synthesis mode) on the basis of face masks or the like assignedas targets of synthesis. Specifically, the control unit 108 generates asynthesized face mask by synthesizing a face mask that has been assignedas src or has been generated from the assigned face image and a facemask that has been assigned as dst or has been generated from theassigned face image in accordance with the synthesis mode.

Here, the synthesis mode includes a first mode in which the synthesizedface mask is generated on the basis of the mesh information of the facemask that is src and a second mode in which the synthesized face mask isgenerated on the basis of the mesh information of the face mask that isdst. The synthesized face mask is generated on the basis of the textureinformation of the face mask that is dst in the first mode while thesynthesized face mask is generated on the basis of the textureinformation of the face mask that is src in the second mode.

For example, the control unit 108 synthesizes a face mask that isgenerated from the face image 12A1 as shown in the left diagram in FIG.4 that has been assigned as src and a face mask that is generated fromthe face image 16A as shown in the left diagram in FIG. 4 that has beenassigned as dst. In the example in FIG. 4, the control unit 108generates a synthesized face mask 36A as shown in the center diagram inFIG. 4 employing the mesh information of the face mask, which isgenerated from the face image 16A that is dst, as mesh information andemploying the texture information of the face mask, which is generatedfrom the face image 12A1 that is src, as texture information inaccordance with the second mode.

In a case in which the synthesis destination is not assigned, thecontrol unit 108 may not perform synthesis. Specifically, if an inputbased on user's motion is interrupted, the control unit 108 does notsynthesize the face masks. In a case in which a dropping operation isperformed at a position where no face mask or face image is displayed,for example, the control unit 108 does not perform synthesis.

(C. Control of Synthesis Mode)

The information processing apparatus 100-1 controls the aforementionedsynthesis mode. Specifically, the control unit 108 controls thesynthesis mode on the basis of input information. More specifically, theinput information includes information related to an image correspondingto a face mask that is src or a face mask that is dst corresponding toan input of processing by the control unit 108. Examples of theinformation related to the image include information related toattributes of the image or content of the image. As the attributes ofthe image, a type of medium (electronic medium) such as a stationaryimage, a moving image, or a through image and a type of content such asa photograph or a computer graphic (CG) are exemplified. In a case inwhich a face mask of a stationary image is dst, and a face mask of amoving image is src, for example, the control unit 108 selects the firstmode. As the content of the image, a speech of a person who appears inthe image and presence or content of actions such as music playing orsports are exemplified.

The input information may be information related to a user's inputoperation. Specifically, the user's input operation includes anoperation of selecting a face mask that serves as src or a face maskthat serves as dst, and the control unit 108 assigns the synthesis modein accordance with a position of selecting the face mask that serves assrc or the face mask that serves as dst. Furthermore, processing ofassigning the synthesis mode in accordance with the position ofselection will be described in detail with reference to FIG. 5. FIG. 5is a diagram showing an example of a face mask displayed by theinformation processing apparatus 100-1 according to the embodiment.

The control unit 108 causes a position of selecting the face mask thatserves as src or the face mask that serves as dst corresponding to eachsynthesis mode, to be displayed in a visually distinguishable form.Specifically, the control unit 108 causes the position of selection tobe displayed in a form different from a form that is specified bytexture information of the face mask displayed. For example, the controlunit 108 causes a face mask 20, in which different colors are applied tothe shaded region A1 and the hatched region A2 as shown in FIG. 5, to bedisplayed. In a case in which the user starts a dragging operation froma starting point in the region A1, for example, the first mode isassigned as the synthesis mode. In a case in which the user starts adragging operation from a starting point in the region A2, the secondmode is assigned as the synthesis mode.

Although the example in which the visually distinguishable form is useof colors has been described hitherto, the form may be use ofbrightness, luminance, patterns, or blinking. In a case in which aposition outside the position of selection corresponding to eachsynthesis mode is selected, the control unit 108 does not assign thesynthesis mode on the basis of the position of selection.

Although the example in which the user's input operation is an operationof selecting the face mask has been described hitherto, the user's inputoperation may be a clicking operation or a tapping operation on thesynthesized face mask in addition to the aforementioned example. Theuser's input operation may be an operation performed on a dedicatedgraphical user interface (GUI). For example, the mode is assigned inaccordance with an operation result of a synthesis mode switching buttonor a synthesis mode assignment menu that is displayed when a droppingoperation is performed. Also, a display object indicating a synthesismode being selected may be displayed on the screen.

(D. Display of Synthesized Face Mask)

The information processing apparatus 100-1 associates and displays agenerated synthesized face mask with a face image. Specifically, thecontrol unit 108 causes a synthesized face mask with to be displayed inassociation with a face image that is specified on the basis of a user'sinput from among face images corresponding to the face mask that is srcand the face mask that is dst. More specifically, the control unit 108causes the synthesized face mask to be displayed in association with theimage corresponding to the face mask of dst after completion of movementfrom the face mask of src to the face mask of dst. For example, thecontrol unit 108 causes the synthesized face mask 36A as shown in thecenter diagram in FIG. 4, which has been obtained by the synthesis, tobe superimposed and displayed on the face image 16A that has beenassigned as dst by a dropping operation. The control unit 108 mayrepresent the texture of the synthesized face mask as being transparentand cause transparency to be reduced with elapse of time when displayingthe synthesized face mask.

(E. Operations on Synthesized Face Mask)

The information processing apparatus 100-1 causes the synthesized facemask to be moved in response to a user's operation in the same manner asthe face masks. Specifically, the control unit 108 causes thesynthesized face mask to be moved in accordance with an input based onuser's motion. For example, the control unit 108 causes the synthesizedface mask 36A as shown in the right diagram in FIG. 4 to be moved inresponse to a dragging operation by the user. The synthesized face maskis changed in accordance with a change in src or dst even while thesynthesized face mask is not superimposed and displayed on a face image.

(F. Saving of Image)

The information processing apparatus 100-1 saves the image on which thesynthesized face mask is superimposed and displayed (hereinafter, alsoreferred to as a processed image). Specifically, if an operation ofsaving the image is detected by the operation detection unit 106 in astate in which the synthesized face mask is displayed on the screen, thecontrol unit 108 causes the storage unit 110 to store the processedimage.

The information processing apparatus 100-1 may allow the user to selectthe processed image and an unprocessed image as a target of the saving.For example, if the operation of saving the image is detected by theoperation detection unit 106, the control unit 108 causes a GUI to bedisplayed on the screen, the GUI allowing the user to select which ofthe processed image and the unprocessed image is to be saved. Then, thecontrol unit 108 saves the processed image or the unprocessed image inaccordance with a selection result.

The information processing apparatus 100-1 may display a display objectthat indicates that the image is a processed image on the screen. Forexample, the control unit 108 causes a marking object to be displayed ata corner of the processed image. Also, the control unit 108 may cause adisplay object like a finger grip at to be displayed a position adjacentto the synthesized face mask, may lower transparency of the outline ofthe synthesized face mask, or may cause the synthesized face mask to bedisplayed as if the synthesized face mask was able to be flipped.

1-3. Processing by Apparatus

Next, processing by the information processing apparatus 100-1 accordingto the embodiment will be described with reference to FIG. 6. FIG. 6 isa flowchart conceptually showing processing by the informationprocessing apparatus 100-1 according to the embodiment.

The information processing apparatus 100-1 determines whether or not anoperation of dragging a face mask or the like has been performed (StepS302). Specifically, the control unit 108 determines whether or not thedragging operation has been detected by the operation detection unit106.

If it is determined that the dragging operation has been performed, theinformation processing apparatus 100-1 assigns src on the basis of thedragging operation (Step S304). Specifically, if the dragging operationis detected by the operation detection unit 106, the control unit 108assigns a face mask at a start position of the detected draggingoperation as src.

Next, the information processing apparatus 100-1 determines whether ornot an operation of dropping the face mask or the like has beenperformed (Step S306). Specifically, the control unit 108 determineswhether or not the dropping operation has been detected by the operationdetection unit 106.

If it is determined that the dropping operation has been performed, theinformation processing apparatus 100-1 assigns dst on the basis of thedropping operation (Step S308). Specifically, if the dropping operationis detected by the operation detection unit 106, the control unit 108assigns a face mask or the like at a position of the detected droppingoperation as dst.

In a case in which the dropping operation is not performed normally, theprocessing ends. Specifically, in a case in which the dropping operationis performed at a position where no face mask or the like is present,the control unit 108 causes the processing to be ended.

Next, the information processing apparatus 100-1 assigns a synthesismode on the basis of input information (Step S310). Specifically, thecontrol unit 108 assigns the synthesis mode on the basis of informationrelated to a face image assigned as src or dst or a face imagecorresponding to the face mask.

Next, the information processing apparatus 100-1 determines the assignedsynthesis mode (Step S312). Specifically, the control unit 108determines which of the first mode and the second mode the assignedsynthesis mode is.

In a case in which the assigned synthesis mode is the first mode, theinformation processing apparatus 100-1 generates a synthesized face maskon the basis of mesh information of the face mask of src and textureinformation of the face mask of dst (Step S314). Specifically, thecontrol unit 108 generates the synthesized face mask that includes themesh information of the face mask of src as mesh information and thetexture information of the face mask of dst as texture information inthe case in which the synthesis mode is the first mode.

In a case in which the assigned synthesis mode is the second mode, theinformation processing apparatus 100-1 generates a synthesized face maskon the basis of mesh information of the face mask of dst and textureinformation of the face mask of src (Step S316). Specifically, thecontrol unit 108 generates the synthesized face mask that includes themesh information of the face mask of dst as mesh information and thetexture information of the face mask of src as texture information inthe case in which the synthesis mode is the second mode.

Next, the information processing apparatus 100-1 associates and displaysthe synthesized face mask with the face image of dst (Step S318).Specifically, the control unit 108 causes the generated synthesized facemask to be superimposed and displayed on the face image corresponding tothe face mask of dst.

1-4. Summary of First Embodiment

According to the first embodiment of the present disclosure, theinformation processing apparatus 100-1 generates a synthesized objectmask by synthesizing a first object mask and a second object mask andcauses the generated synthesized object mask to be displayed inassociation with an image corresponding to the first object mask or thesecond object mask. Also, the information processing apparatus 100-1controls the mode for synthesis on the basis of input information.Therefore, it is possible to perform synthesis that is desirable for theuser by performing synthesis in accordance with the input information.

A first object mask includes a first face mask, a second object maskincludes a second face mask, and a synthesized object mask includes asynthesized face mask. Therefore, it is possible to allow the user toenjoy the face, which is a characteristic part of a human body, being asa target of synthesis. The target of the object mask may be an objectother than a human, and for example, a natural object such as avegetable or a rock or an artificial object such as a clock. The objectincludes a part of an object as described above. Therefore, the targetof the object mask may be another part of a human body other than theface or may be a part of an object other than a human.

The mode includes a first mode in which the synthesized face mask isgenerated on the basis of mesh information of the first face mask and asecond mode in which the synthesized face mask is generated on the basisof mesh information of the second face mask. Therefore, it is possibleto select an expression of a face of the synthesized face mask from anexpression of the face of the face mask of src or dst by switching themesh information of the synthesized face mask by the synthesis mode. Asa result, convenience for the user can be improved.

In the first mode, the synthesized face mask is generated on the basisof the texture information of the second face mask. In the second mode,the synthesized face mask is generated on the basis of the textureinformation of the first face mask. Therefore, the synthesized face maskis automatically switched, and it is possible to improve the conveniencefor the user by changing the combination of the mesh information and thetexture information in accordance with the synthesis mode.

The information processing apparatus 100-1 causes the synthesized facemask to be displayed in association with an image specified on the basisof a user's input from among the images corresponding to the first facemask and the second face mask. Therefore, it is possible to improve theconvenience for the user by superimposing and displaying the synthesizedface mask on the face image designated by the user.

The input information includes information related to the imagecorresponding to the first face mask or the second face mask as an inputof the control processing. Therefore, it is possible to suppress afeeling of strangeness given to the user and to intentionally give thefeeling of strangeness to the user in contrast by performing synthesissuitable for the face image, in particular, the face image on which thesynthesized face mask is superimposed and displayed.

The aforementioned information related to the image includes informationrelated to attributes of the aforementioned image and content of theaforementioned image. Therefore, it is possible to reduce a processingload in the synthesis in accordance with the attributes of the image ascompared with synthesis in accordance with the content of the image.Also, it is possible to perform synthesis suitable for a displayed sceneby the synthesis according to the content of the image as compared withthe synthesis in accordance with the attributes of the image.

In addition, the input information includes information related to auser's input operation. Therefore, it is possible to improve theconvenience for the user by performing the synthesis that meetsintension of the user.

The user's input operation includes an operation of selecting the firstface mask or the second face mask, and the information processingapparatus 100-1 assigns the mode in accordance with the selectionposition of the first face mask or the second face mask. Therefore, itis possible to improve the operability by enabling the selection of thesynthesis mode when the target of synthesis is selected.

The information processing apparatus 100-1 causes the selection positionof the first face mask or the second face mask corresponding to eachmode to be displayed in a visually distinguishable form. Therefore, theuser easily knows the selection position, and it is possible to improvethe convenience for the user.

At least one of the images corresponding to the first face mask and thesecond face mask includes an image that is temporarily recorded by imagecapturing. Therefore, it is possible for the user to observe how thesynthesis proceeds during image capturing and to undergo trial anderror. In this manner, it is possible to improve the convenience for theuser.

According to the first embodiment of the present disclosure, theinformation processing apparatus 100-1 causes the first object mask orthe second object mask to be moved, for synthesis, in response to aninput based on user's motion with respect to the screen on which theobject mask or the image corresponding to the object mask is displayed.Therefore, it is possible to improve an operational feeling forsynthesis by moving the face mask in accordance with intentions of theuser.

After completion of movement from one of the first face mask and thesecond face mask to the other, the information processing apparatus100-1 causes the synthesized face mask to be displayed in associationwith the image corresponding to the other face mask. Therefore, it ispossible to improve the operational feeling by assigning timing at whichthe synthesized face mask is displayed in accordance with the user'smotion.

If the input based on the user's motion is interrupted, the informationprocessing apparatus 100-1 does not perform synthesis. Therefore, it ispossible to improve the convenience for the user by interrupting thesynthesis in accordance with intentions of the user.

The input based on the user's motion include an operation of assigningboth a start point and an end point or an operation of assigning onlythe start point. Therefore, the use can sensually operate the face mask,and the operability can be further improved.

The first face mask or the second face mask to be moved includes a facemask that is lined up in a face list displayed on the screen and a facemask that is generated from an image lined up in the face list.Therefore, it is possible to set a face, which does not appear on thescreen, as a target of synthesis and to widen options for the user byselecting the face mask or the face image that serves as src in the facelist.

The information processing apparatus 100-1 selects the face mask or theimage lined up in the face list on the basis of attributes of the faceexpressed by the first face mask or the second face mask. Therefore, itis possible to improve a degree of satisfaction of the user with respectto the face mask or the face image listed up by lining up the face maskor the face image that suits a face as a synthesis candidate in the facelist.

At least one of the first face mask and the second face mask includes aface mask of the user. Therefore, it is possible to cause the face ofhis or her own to be synthesized with another face, to cause anotherface to be synthesized with the face of his or her own, and to therebysimulate a hair style, fashion, or the like that suits the user.

1-5. Modification Examples

The first embodiment of the present disclosure has been describedhitherto. The embodiment is not limited to the aforementioned example.Hereinafter, first to tenth modification examples of the embodiment willbe described.

First Modification Example

According to the first modification example of the embodiment, theinformation processing apparatus 100-1 may generate a synthesized facemask on the basis of both mesh information pieces or both textureinformation pieces of targets of synthesis. Specifically, the synthesismode includes a third mode in which the synthesized face mask isgenerated on the basis of mesh information of the face mask that servesas src and mesh information of the face mask that serves as dst andtexture information of the face mask that serves as src and textureinformation of the face mask that serves as dst.

For example, the control unit 108 assigns a mesh of the synthesized facemask by causing a mesh of the face mask that serves as src and a mesh ofthe face mask that serves as dst to be synthesized in the third mode.For example, the mesh of the synthesized face mask in the third mode maybe obtained by averaging the mesh of src and the mesh of dst. Thetexture is handled in the same manner as the aforementioned mesh. It isa matter of course that the third mode is controlled on the basis of theinput information in the same manner as in the first mode and the secondmode.

According to the first modification example of the embodiment, thesynthesis mode includes the third mode in which the synthesized facemask is generated on the basis of the mesh information of the face maskthat serves as src and the mesh information of the face mask that servesas dst and the texture information of the face mask that serves as srcand the texture information of the face mask that serves as dst asdescribed above. Therefore, it is possible to more finely set the degreeof synthesis and to thereby address various user's needs.

Second Modification Example

According to the second modification example of the embodiment, in acase in which a plurality of face masks that become dst are present, theinformation processing apparatus 100-1 may generate synthesized facemasks for all the plurality of face masks. Specifically, in a case inwhich a plurality of face masks or face images are displayed on thescreen, the control unit 108 respectively generate the synthesized facemask on the basis of a moved face mask and each of the plurality of facemasks or face images. Furthermore, processing according to themodification example will be described in detail with reference to FIGS.7 and 8. FIG. 7 is a diagram illustrating processing of generating aplurality of synthesized face masks on the basis of a face mask or thelike selected from a face list according to the second modificationexample of the embodiment, and FIG. 8 is a diagram illustratingprocessing of generating a plurality of synthesized face mask on thebasis of a face mask or the like selected from face images or the likedisplayed on the screen according to the second modification example ofthe embodiment.

The control unit 108 performs synthesis if a face mask or the like ismoved to one of a plurality of face masks or face images correspondingto the face masks. For example, generation of a plurality of synthesizedface mask based on the face mask or the like selected from the face listwill be considered. If a face image 12B3 lined up in the face list asshown in the left diagram in FIG. 7 is moved to any of a stationary faceimages 14B1 to 14B4, the control unit 108 performs synthesis of each offace masks of face images 14B1 to 14B4 with a face mask of a face image12B3 in the second mode. As a result, each of generated synthesized facemask 34B1 to 34B4 is superimposed and displayed on each of the faceimages 14B1 to 14B4 as shown in the right drawing in FIG. 7.

For example, generation of a plurality of synthesized face masks basedon a face mask or the like that is selected from face images or the likedisplayed on the screen will be considered. If a stationary face image14C1 as shown in the left drawing in FIG. 8 is moved to any of the otherface images 14C2 to 14C4, for example, the control unit 108 performssynthesis of each of face masks of the face images 14C2 to 14C4 with theface mask of the face image 14C1 in the second mode. As a result, eachof the generated synthesized face masks 34C2 to 34C4 is superimposed anddisplayed on each of the face images 14C2 to 14C4 as shown in the rightdrawing in FIG. 8.

The control unit 108 may perform synthesis without causing the face maskor the like that serves as src to be moved. For example, the controlunit 108 performs synthesis with a plurality of face masks or the likethat serve as dst if the face mask or the like that serves as src isselected.

It is a matter of course that the synthesized face mask may be generatedfor one selected from the plurality of face masks or the like.

The control unit 108 may switch a target of generation of thesynthesized face mask on the basis of a user's operation in a case inwhich a plurality of face masks or the like are displayed on the screen.Specifically, the control unit 108 switch the target of generating thesynthesized face mask on the basis of an operation performed on adisplay object. For example, if a button object 40 as shown in FIG. 8 isset to be on, the control unit 108 sets all the plurality of face masksas the targets of generation of synthesized face masks. Also, if thebutton object 40 as shown in FIG. 8 is set to be off, the control unit108 sets one of the plurality of face masks or the like as a target ofgeneration of a synthesized face mask.

According to the second modification example of the embodiment, theinformation processing apparatus 100-1 respectively generates asynthesized face mask on the basis of a moved face mask and each of theplurality of face masks or face images in a case in which the pluralityof face masks or face images are displayed on the screen. Therefore, itis possible to omit time and efforts of the user required for synthesiswith the plurality of face masks.

If the face mask or the like is moved to one of the plurality of facemasks or face images corresponding to the face masks, the control unit108 performs synthesis. Therefore, it is possible to improve easiness ofoperations by integrating an interface for synthesis regardless of thenumber of dst.

Third Modification Example

According to the third modification example of the embodiment, theinformation processing apparatus 100-1 may register a face mask or thelike in a face list on the basis of a user's operation. Specifically,the control unit 108 adds the face mask moved toward the face list tothe face list. Furthermore, registration processing in the face listwill be described in detail with reference to FIG. 9. FIG. 9 is adiagram illustrating registration processing in a face list according tothe third modification example of the embodiment.

The control unit 108 prepares a registration frame in a face list.Although no face mask or the like is lined up in the face list as shownin the left diagram in FIG. 9 before the registration in the face list,objects indicating frames in which registration can be made are linedup.

Next, if the face mask or the like moves to the face list, the controlunit 108 adds the face mask or the like to the face list. If the facemask generated from a through face image 16D as shown on the left upperside in the left drawing in FIG. 9 is moved by the user to the facelist, for example, the control unit 108 adds a face mask 22D to the facelist as shown in the right diagram in FIG. 9.

Next, the control unit 108 performs synthesis by using the face mask orthe like registered in the face list as src. For example, the controlunit 108 generate the synthesized face mask by using the face mask 22Das src and each face image at a destination of movement as dst in thesecond mode by causing the face mask 22D registered in the face list tobe moved to the face images 14D1 to 14D3. Then, each of the generatedsynthesized face masks 34D1 to 34D3 is superimposed and displayed oneach of the face images 14D1 to 14D3.

If the face images are moved to the face list, the control unit 108 mayregister the face masks generated from the face images in the face list.If the user causes his or her face or the information processingapparatus 100-1 to be moved such that his or her face that appears in athrough image moves to the face list, for example, the control unit 108generates a face mask from the user's face in the through image andregister the generated face mask in the face list.

The control unit 108 may register a face mask in the face list on thebasis of an operation that is not accompanied by movement of the facemask or the like. In a case in which a selection operation, such as atough operation, on a face mask or the like is continued forpredetermined time, for example, the control unit 108 adds the face maskrelated to the selection operation to the face list. In such a case, thecontrol unit 108 may cause a GUI for checking availability ofregistration to be displayed after detection of the continuation of theselection operation. The control unit 108 may add an image selected bythe user from among images obtained by image capturing and images storedin the storage unit 110.

The control unit 108 may automatically generate the face list. Forexample, the control unit 108 generates a face mask for a face thatappears in an image (including a stationary image, a moving image, and athrough image) obtained by image capturing and adds the generated facemask to the face list. Also, the control unit 108 may generate a facemask for a face that is an object during image capturing and adds thegenerated face mask to the face list. Also, the face mask onceregistered may be updated. For example, if a face image or a face maskthat directs toward a direction close to a front side than face masksthat have already been registered is acquired, the control unit 108registers the newly acquired face mask instead of the face mask that hasalready been registered.

A face mask or the like may be deleted from the face list. Specifically,the control unit 108 deletes the face mask or the like from the facelist on the basis of a user's operation. In a case in which the facemask or the like lined up in the face list is moved to the outside ofthe face list by a dragging and dropping operation, for example, thecontrol unit 108 deletes the moved face mask or the like from the facelist.

The control unit 108 may automatically delete a face mask or the likefrom the face list. For example, the control unit 108 deletes a facemask or the like for which predetermined time has elapsed afterregistration in the face list. Also, the control unit 108 may delete aface mask or the like outside an imaging range from the face list. Ifimage capturing ends or an imaging screen is printed, the control unit108 may delete a face mask or the like from the face list. Also, thecontrol unit 108 may delete a face mask or the like on the basis ofposition information of the user. When the user leaves a predeterminedregion, the control unit 108 deletes a face mask or the likecorresponding to the predetermined region.

According to the third modification example of the embodiment, theinformation processing apparatus 100-1 adds a face mask moved toward theface list to the face list as described above. Therefore, the user cansensually create the face list, and the operability can be improved.

Fourth Modification Example

According to the fourth modification example of the embodiment, theinformation processing apparatus 100-1 may cause a synthesized face maskto be displayed in association with a face other than a real human face.Specifically, a face mask used for synthesis includes a face mask of anartificially generated face (hereinafter, also referred to as anartificial face). For example, the control unit 108 synthesizes the facemask generated from the face image of the artificial face with anotherface mask. Then, the control unit 108 causes the synthesized face maskobtained by the synthesis to be superimposed and displayed on the faceimage of the artificial face. Furthermore, processing according to themodification example will be described with reference to FIG. 10. FIG.10 is a diagram illustrating synthesis processing according to thefourth modification example of the embodiment.

The artificial face includes a face depicted as a picture. If a facemask generated from a through face image 16E is moved toward a faceimage 14E of a woman face that is depicted as a picture as shown in theleft diagram in FIG. 10, for example, the control unit 108 synthesizes aface mask generated from the face image 14E with the moved face mask inthe second mode. Then, the control unit 108 causes a synthesized facemask 34E obtained by the synthesis to be superimposed and displayed onthe face image 14E as shown in the right drawing in FIG. 10. It is amatter of course that a face mask registered in the face list, forexample, a face mask 22E1 may be used for synthesis instead of the facemask generated from the through face image 16E.

The artificial face may be a face created by CG A natural object such asa vegetable or a rock that is in a face-like form though it is not anartificial object may be used instead of the artificial face.

According to the fourth modification example of the embodiment, the facemask used for synthesis includes a face mask of an artificiallygenerated face as described above. Therefore, it is possible to addressvarious user's needs by expanding targets of synthesis.

Fifth Modification Example

According to the fifth modification example of the embodiment, theinformation processing apparatus 100-1 may present a prior display of asecond synthesized face mask (hereinafter, also referred to as a previewof a synthesized face mask) related to the synthesized face mask.Specifically, the preview of the synthesized face mask includes causinga face mask, which is being moved, to be changed into the secondsynthesized face mask, and the second synthesized face mask includes asynthesized face mask. For example, the control unit 108 causes a facemask that is selected as a target of movement to be changed into asynthesized face mask obtained by synthesizing the face mask with a facemask estimated as a movement destination. In a case in which the movingoperation is a dragging operation, for example, the control unit 108performs preview by using a face mask that is present in a draggingdirection as a face mask that serves as dst. A swiping operation or aflicking operation is also performed in the same manner as in the caseof the dragging operation.

The second synthesized face mask includes a synthesized face maskobtained by causing face feature information in the synthesized facemask to be changed in accordance with information related to movement ofthe face mask, which is being moved. Specifically, the face featureinformation of the synthesized face mask related to the preview ischanged in accordance with a distance between the face mask that servesas src and the face mask that serves as dst, which changes by themovement. For example, the control unit 108 causes the face mask that isbeing moved to be changed to the synthesized face mask that is closer tothe synthesized face mask after the movement as the distance decreases.More specifically, the control unit 108 causes a mesh and texture of theface mask, which is being moved, to further approach a mesh and textureof the synthesized face mask as the distance decreases. The movingoperation may be a dragging operation or a swiping operation.

The face feature information of the synthesized face mask related to thepreview may be changed in accordance with a moving direction of the facemask. If the face mask is moved in a predetermined direction, forexample, the control unit 108 causes the moved face mask to be changedinto a synthesized face mask in which a mesh and texture of the facemask of src are emphasized. In addition, if the face mask is moved in adirection opposite to the predetermined direction, the control unit 108causes the moved face mask to be changed into a synthesized face mask inwhich the mesh and the texture of the face mask of dst are emphasized.

Also, the face feature information of the synthesized face mask relatedto the preview may be changed in accordance with a moving speed of theface mask. For example, the control unit 108 causes the mesh and thetexture of the moved face mask to further approach the mesh and thetexture of the synthesized face mask as the moving speed of the facemask becomes higher. In a case in which the moving speed is equal to orgreater than a threshold value, the control unit 108 may cause the movedface mask to be changed into the synthesized face mask.

The preview of the synthesized face mask may be causing a face masklined up in the face list or a face mask generated from a face imagelined up to be changed into the second synthesized face mask.Specifically, the control unit 108 causes a face mask that is lined upin the face list, a face mask that is selected from among the faceimages, or a face mask that is generated from the selected face image tobe changed into the second synthesized face mask. Furthermore, thepreview in the face list will be described in detail with reference toFIG. 11. FIG. 11 is a diagram illustrating the preview in the face listaccording to the fifth modification example of the embodiment.

The control unit 108 synthesizes one face mask or each of a plurality offace masks selected from the face list by a user's operation with a facemask of a face on a screen, which has been recognized by the facerecognition unit 104. For example, the control unit 108 respectivelysynthesizes face masks lined up in the face list with face masksgenerated from face images 14F1 to 14F3 that respectively correspond tothe face masks in the first mode.

Then, the control unit 108 respectively causes each of the generatedsynthesized face masks to be displayed instead of the selectedcorresponding face masks in the face list. For example, the control unit108 causes synthesized face masks 32F1 to 32F3 to be displayed insteadof the face masks in the face list as shown in FIG. 11. In a case inwhich a face image is selected in the face list, the synthesized facemask may be superimposed and displayed on the face image.

The control unit 108 may use all face masks or the like lined up in theface list as targets of preview. The targets of preview may be switchedon the basis of a user's operation.

The synthesized face mask in the preview may be updated on the basis ofthe mesh information of src or dst. For example, a face expression ofthe synthesized face mask in the preview is changed in accordance withmotion of the face of src or dst.

Although the example in which the face mask or the like that serves asdst is changed into the synthesized face mask has been describedhitherto, the face mask or the like that serves as src may be changedinto the synthesized face mask.

Although the example in which the preview is performed by changing theface mask or the like as a target of synthesis into the synthesized facemask has been described hitherto, an additional screen for the previewmay be provided, and the preview of the synthesized face mask may bedisplayed on the screen.

According to the fifth modification example of the embodiment, theinformation processing apparatus 100-1 presents a prior display of thesecond synthesized face mask related to the synthesized face mask.Therefore, since a state after the synthesis is presented in advance,the user can decide whether or not to execute synthesis before thesynthesis, and the convenience for the user can be improved.

The prior display of the second synthesized face mask includes causingthe face mask, which is being moved, to be changed into the secondsynthesized face mask. Therefore, since the preview of the synthesizedface mask is performed during a moving operation for synthesis, it ispossible for the user to determine whether or not to execute thesynthesis during movement.

The second synthesized face mask includes a synthesized face mask inwhich face feature information of the synthesized face mask is changedin accordance with a distance between the face mask that serves as srcand the face mask that serves as dst. Therefore, the user can check theprocess of the synthesis through a moving operation, and it is possibleto provide a fan to the user.

The prior display of the second synthesized face mask includes causingface masks lined up in the face list or face masks generated from faceimages lined up in the face list to be changed into the secondsynthesized face masks. Therefore, since the face masks lined up in theface list become targets of the preview, the user can observe thepreview without performing a moving operation.

The information processing apparatus 100-1 causes a face mask selectedfrom face masks or face images lined up in the face list or all the facemasks to be changed into the second synthesized face mask or secondsynthesized face masks.

Therefore, since only the face masks intended by the user are regardedas targets of preview, the user can focus on and observe the synthesizeface masks that the user desires to check.

Sixth Modification Example

According to the sixth modification example of the embodiment, theinformation processing apparatus 100-1 may secure a face mask of a faceimage, on which the synthesized face mask is superimposed and displayed,when the synthesized face mask is superimposed and displayed.Specifically, the control unit 108 causes a face mask corresponding toan image associated with a synthesized face mask to be displayed to beadjacent to the synthesized face mask when the synthesized face mask isdisplayed. Furthermore, processing according to the modification examplewill be described in detail with reference to FIGS. 12 and 13. FIG. 12is a diagram illustrating synthesis processing in a case in which a facemask is not secured according to the sixth modification example of theembodiment, and FIG. 13 is a diagram illustrating synthesis processingin a case in which a face mask is secured according to the sixthmodification example of the embodiment.

First, a case in which the face mask is not secured will be described.The control unit 108 generates a synthesized face mask if a face maskthat serves as src is moved to a face mask or the like that serves asdst. If a face mask 26G that is generated from a through face image 16Gis moved to a moving face image 18G by a dragging operation as shown inthe left diagram in FIG. 12, the control unit 108 synthesizes the facemask 26G and a face mask generated from the face image 18G in the secondmode.

Next, the control unit 108 causes the generated synthesized face mask tobe superimposed and displayed on the face image that serves as dst. Forexample, the control unit 108 causes the generated synthesized face mask38G to be superimposed and displayed on the face image 18G that servesas dst. Here, since the synthesized face mask 38G is superimposed anddisplayed on the face image 18G, it is difficult for the user to performan operation of generating the face mask from the face image 18G on theface image 18G in a case in which the user desires to generate the facemask of the face image 18G. Thus, the face mask is secured in theinformation processing apparatus 100-1 as will be described later.

If the face mask that serves as src is moved to the face mask or thelike that serves as dst, the control unit 108 generates the synthesizedface mask. If a face mask generated from a stationary face image 14H ismoved to a through face image 16H by a dragging operation as shown inthe left diagram in FIG. 13, the control unit 108 synthesizes the movedface mask with the face mask generated from the face image 16H in thesecond mode.

Next, the control unit 108 causes the generated synthesized face mask tobe superimposed and displayed on the face image that serves as dst andcauses the face mask generated from the face image that serves as dst tobe displayed at a position adjacent to the synthesized face mask. Asillustrated in the left diagram in FIG. 13, for example, the controlunit 108 causes the generated synthesized face mask 36H to besuperimposed and displayed on the face image 16H that serves as dst andcauses a face mask 26H generated from the face image 16H to be displayedon the synthesized face mask 36H, that is, the face image 16H.

The secured face mask can be moved and synthesized in the same manner asin the aforementioned face masks. If the face mask 26H generated to besecured is moved to the face image 14H as shown in the center diagram inFIG. 13, for example, the control unit 108 synthesizes the face mask 26Hand the face mask generated from the face image 14H in the second mode.

Next, the control unit 108 causes the generated synthesized face mask tobe superimposed and displayed on the face image that serves as dst andcauses the face mask generated from the face image that serves as dst tobe displayed at a position adjacent to the synthesized face mask. Forexample, the control unit 108 causes the generated synthesized face mask34H to be superimposed and displayed on the face image 14H and causes aface mask 24H generated from the face image 14H to be displayed on thesynthesize face mask 34H, that is, the face image 14H. As a result,display is performed such that face related to the face image has beenswitched.

Whether to secure the aforementioned face mask may be switched.Specifically, the control unit 108 switches whether to secure the facemask on the basis of a user's operation. For example, the control unit108 switches whether to secure the face mask in accordance withswitching between on and off of the button object 50 as shown in theleft diagram in FIG. 13.

According to the sixth modification example of the embodiment, theinformation processing apparatus 100-1 causes the face maskcorresponding to the image associated with the synthesized face mask tobe displayed to be adjacent to the synthesized face mask when thesynthesized face mask is displayed as described above. Therefore, it ispossible to perform an operation on the face mask of the face image onwhich the synthesized face mask is superimposed and displayed, and tothereby improve the convenience for the user.

Seventh Modification Example

According to the seventh modification example of the embodiment, theinformation processing apparatus 100-1 may change face featureinformation of the synthesized face mask. Specifically, the control unit108 changes face feature information of the synthesized face mask on thebasis of input information. More specifically, the control unit 108changes the face feature information of the synthesized face maskbetween face feature information of the face mask that serves as src andface feature information of the face model that serves as dst on thebasis of a user's input operation. Furthermore, processing according tothe modification example will be described in detail with reference toFIG. 14. FIG. 14 is a diagram showing an example of an interface foradjusting face feature information of a synthesized face mask accordingto the seventh modification example of the embodiment.

The control unit 108 provides interface for adjusting the face featureinformation of the synthesized face mask to the user. For example, thecontrol unit 108 causes a GUI 60 as shown in FIG. 14 to be displayed.The GUI 60 includes an interface like a slider for adjusting meshinformation of the synthesized face mask and an interface like a sliderfor adjusting texture information of the synthesized face mask. Forexample, the left end of the slider corresponds to src while the rightend of the slider corresponds to dst.

In a case in which a finger grip of the slider for the mesh informationis set at the left end and a finger grip of the slider for the textureinformation is set at the right end, the face feature information of thesynthesized face mask corresponds to face feature information in theaforementioned first mode. In a case in which the respective fingergrips of the two sliders are respectively set in the opposite manner,the feature information of the synthesized face mask corresponds to theface feature information in the aforementioned second mode. In a case inwhich the respective finger grips of the two sliders are set between theleft end and the right end, the face feature information of thesynthesized face mask corresponds to the face feature information in theaforementioned third mode.

Then, the control unit 108 causes display of the synthesized face maskto be changed on the basis of the face feature information set throughthe interface. For example, the control unit 108 changes meshinformation and texture information of the synthesized face mask asshown in FIG. 14 into mesh information and texture information set bythe sliders in the GUI 60. The control unit 108 may cause thesynthesized face mask to be changed in real time in response to anoperation on the GUI 60 or may cause the synthesized face mask to bechanged after completion of an operation on the GUI 60, for example,after an ending operation.

The face feature information of the synthesized face mask may be changedregardless of the face feature information of the face masks that serveas src and dst. Specifically, the control unit 108 changes the meshinformation of the synthesized face mask on the basis of attributeinformation of the face mask that serves as src or the face mask thatserves as dst. Furthermore, the configuration will be described indetail with reference to FIGS. 15A to 15C. FIGS. 15A to 15C are diagramsillustrating processing of changing the mesh information of thesynthesized face mask according to the seventh modification example ofthe embodiment.

The control unit 108 selects a mesh type on the basis of the attributeinformation of the mask and changes the mesh information on the basis ofthe selected mesh type. For example, types of a face wear such as afacial mask or a medical mask, a cartoon or CG character, or presence offront bangs is exemplified are exemplified as the attribute informationof the face mask. In a case in which the type of the face mask is a facewear, for example, the control unit 108 selects a mesh type that dropsout at a part of a face, such as a forehead or eyes as shown in FIG. 15Aor FIG. 15B. In a case in which the type of the face mask is acharacter, the control unit 108 selects a mesh type that is set to begreater than the other mesh types such that a part of a face, such aseyes, is deformed as shown in FIG. 15C.

The control unit 108 may dynamically change the mesh information insteadof or in addition to selection of the mesh type. This configuration willbe described in detail with reference to FIG. 16. FIG. 16 is a diagramillustrating another example of processing of changing mesh informationof a synthesized face mask according to the seventh modification exampleof the embodiment.

The control unit 108 dynamically changes the mesh information inresponse to a user's operation. Specifically, the control unit 108changes a part of the mesh information to have a size selected by theuser's operation. For example, the control unit 108 causes a size of apart corresponding to eyes in the mesh to be changed to 1.0 to 1.5 foldsset by the user's operation as in the synthesized face masks 3611 to3613 shown in FIG. 16.

The control unit 108 may change texture information of the synthesizedface mask on the basis of a face image with which the synthesized facemask is associated or the face mask of the target of synthesis.Specifically, the control unit 108 changes the texture information ofthe synthesized face mask on the basis of a comparison between textureinformation of the face mask that serves as src and texture informationof the face mask or the like that serves as dst. Furthermore, thisconfiguration will be described in detail with reference to FIGS. 17 and18. FIGS. 17 and 18 are respectively diagrams for illustratingprocessing of changing the texture information of the synthesized facemask according to the seventh modification example of the embodiment.

First, a case in which the texture information is not changed will bedescribed. If the synthesized face mask is generated, the control unit108 causes the generated synthesized face mask to be superimposed anddisplayed on the face image that serves as dst. For example, the controlunit 108 causes a synthesized face mask 36J1 as shown in the leftdiagram in FIG. 17 to be displayed. Here, since a color tone of thetexture of the synthesized face mask 36J1 is different from a color toneof the face image that is superimposed and displayed, there is apossibility that the user feels that the synthesis is unnatural. Thus,the control unit 108 changes transparency of the texture of thesynthesized face mask in accordance with a degree of a visual differencebetween the texture of the face mask that serves as src and the textureof the face mask that serves as dst.

Specifically, the control unit 108 changes the transparency of thetexture of the synthesized face mask in accordance with a degree ofdifference in luminance or in color attributes (color phases,brightness, or saturation) of the texture of the face mask that servesas src and the texture of the face mask that serves as dst. For example,the control unit 108 raises transparency of the texture in the peripheryof the outline of the synthesized face mask as a synthesized face mask36J2 shown in the right drawing in FIG. 17. In this manner, it ispossible to suppress the feeling of strangeness.

The control unit 108 may change the color attributes of the textureinstead of or in addition to the change of the transparency of thetexture. Specifically, the control unit 108 changes the color attributesof the texture of the synthesized face mask in accordance with a degreeof difference in luminance or in color attributes between the texture ofthe face mask that serves as src and the texture of the face mask thatserves as dst. For example, the control unit 108 changes the synthesizedface mask from a synthesized face mask 36K1 as shown in the rightdiagram in FIG. 18 to a synthesized face mask 36K2 as shown in the rightdiagram in FIG. 18 by causing brightness of the texture of thesynthesized face mask to be lowered. In this manner, it is possible tosuppress the feeling of strangeness.

The aforementioned processing of changing the face feature informationof the synthesized face mask may be performed after the synthesis orduring the synthesis.

According to the seventh modification example of the embodiment, theinformation processing apparatus 100-1 changes the face featureinformation of the synthesized face mask on the basis of the inputinformation as described above. Therefore, since the synthesized facemask suitable for the input information is displayed, it is possible toimprove visibility of the synthesized face mask from the user.

The information processing apparatus 100-1 changes the face featureinformation of the synthesized face mask between the face featureinformation of the face mask that serves as src and the face featureinformation of the face model that serves as dst. Therefore, since itbecomes easy to finely set the face feature information of thesynthesized face mask, it is possible to improve the convenience for theuser. In a case in which the face feature information of the synthesizedface mask is changed in real time in response to a user's inputoperation after the synthesis, in particular, the user can makeadjustment while checking the change in the synthesized face mask, andit is thus possible to further improve the convenience.

The information processing apparatus 100-1 changes the mesh informationof the synthesized face mask on the basis of attribute information ofthe face mask that serves as src or the face mask that serves as dst.Therefore, since the synthesized face mask is changed regardless ofwhich of src and dst the face mask corresponds to, user's options arewidened, and it is possible to address various user's needs. Also, sincethe mesh information of the synthesized face mask is changed, it ispossible to change a face expression expressed by the synthesized facemask and to fit the synthesized face mask to the synthesis destination.

The information processing apparatus 100-1 changes the textureinformation of the synthesized face mask on the basis of the face imagewith which the synthesized face mask is related or the face mask as thetarget of synthesis. Therefore, since the texture information of thesynthesized face mask is changed, it is possible to change a face colorexpressed by the synthesized face mask and to fit the synthesized facemask to the synthesis destination.

Eighth Modification Example

According to the eighth modification example of the embodiment, theinformation processing apparatus 100-1 may use face feature informationof another face mask in a case in which the face feature information forgenerating the synthesized face mask is insufficient. Here, there is acase in which the number of detected feature points in the face imagecorresponding to the face mask decreases by a person who appears in amoving image or a through image shaking his or her head or by changing acamera work. In such a case, the amounts of mesh information and textureinformation of the face mask of src or dst decrease and there is apossibility that a synthesized face mask that gives a feeling ofstrangeness to the user is generated. Thus, the control unit 108 usesface feature information of a face mask in the past in order tocomplement the insufficient face feature information.

Specifically, if the face mask is generated or updated, the control unit108 causes the face feature information to be stored. For example, thecontrol unit 108 temporarily causes the storage unit 110 to storefeature point information of the face mask until a predetermined timeelapses after the generation or the updating of the face mask.

Then, the control unit 108 acquires the stored face feature informationin the past and complement the insufficient face feature information ina case in which the face feature information is insufficient. In a casein which the number of detected feature points is equal to or less thana threshold value, for example, the control unit 108 uses stored featurepoints in the past to complement the insufficient feature points.

Another face mask that has the face feature information that is used forthe complementation may be a face mask of src or dst as a counterpart ofthe synthesis. In a case in which the number of detected feature pointsin the face mask of src is equal to or less than the threshold value,for example, the control unit 108 complements the feature points of srcby using feature points of the face mask of dst corresponding to featurepoints that have not been detected in the face mask of src.

The transparency of the synthesized face mask may be changed inaccordance with the number of detected feature points. For example, thecontrol unit 108 sets a higher transparency for the texture of thesynthesized face mask as the number of detected feature points in theface mask that serves as src or dst is smaller. Here, the meshinformation and the texture information decrease, and appearance of thesynthesized face mask becomes rougher as the number of the detectedfeature points decreases. However, since the transparency of thesynthesized face mask increases as the number of detected feature pointsdecreases according to the configuration, the user does not clearlyvisually recognize the synthesized face mask, and it is possible toobscure the roughness of the synthesized face mask.

In a case in which no feature points are detected, the synthesized facemask may be deleted. In a case in which no feature points of the facemask that serves as src or dst are detected, for example, the controlunit 108 causes the synthesized face mask to fade out by graduallyincreasing the transparency of the texture of the synthesized face mask.

The face mask of src or dst for which the feature points have beendetected may be superimposed and displayed instead of the synthesizedface mask rather than deleting the synthesized face mask. In such acase, synthesis processing is not performed.

According to the eighth modification example of the embodiment, theinformation processing apparatus 100-1 uses the face feature informationof another face mask in a case in which the face feature information forgenerating the synthesized face mask is insufficient. Therefore, sincethe display of the synthesized face mask is continued even in a case inwhich a part of feature points are not detected, it is possible tosuppress frequent switching between display and non-display of thesynthesized face mask and to maintain the visibility from the user.

Another face mask includes a face mask that serves as src or a face maskthat serves as dst, which is a counterpart of the synthesis, or a facemask in the past. Therefore, since the complementation is made with thefeature points that have compatibility to the synthesized face mask, itis possible to cause the possibility that the feeling of strangeness isgiven to the user who observes the synthesized face mask to be reduced.

Ninth Modification Example

According to the ninth modification example of the embodiment, theinformation processing apparatus 100-1 may perform synthesis of anobject other than a face. Specifically, the control unit 108 performssynthesis in which at least one of models of src and dst is an objectmodel other than a face. For example, a face model is connected to animage of an object other than a face in advance. Then, the control unit108 synthesizes the face model connected to the image of the object witha face model of a face image and causes the synthesized face modelobtained by the synthesis to be superimposed and displayed on the imageof the object or the face image. Furthermore, processing according tothe modification example will be described in detail with reference toFIGS. 19 and 20. FIG. 19 is a diagram showing processing of synthesizingan object other than a face according to the ninth modification exampleof the embodiment, and FIG. 20 is a diagram showing another example ofprocessing of synthesizing an object other than a face according to theninth modification example of the embodiment.

An object other than a face includes an illustration. For example, aface model is connected to a kabuki illustration image 12L lined up in aface list as shown in FIG. 19 in advance. In a case in which the objectis an object that is close to a face, a face model is generated throughface recognition processing. If the illustration image 12L or the facemodel connected to the image 12L is moved to another face model or aface image, the control unit 108 performs synthesis of the face modelconnected to the image 12L with the face model or the face modelgenerated from the face image at the movement destination. Then, thecontrol unit 108 causes the synthesized face model 36L obtained by thesynthesis as shown in FIG. 19 to be superimposed and displayed on theface image at the movement destination.

The object other than a face includes an image for superimposition. Forexample, a make-up image 12M lined up in a face list as shown in FIG. 20is connected to a face model in advance. If the make-up image 12M or aface model connected to the make-up image 12M is moved to another facemodel or a face image, the control unit 108 performs synthesis of theface model connected to the make-up image 12M with the face model or theface model generated from the face image at the movement destination.Then, the control unit 108 causes the synthesized face model 36Mobtained by the synthesis as shown in FIG. 20 to be superimposed anddisplayed on the face image at the movement destination.

Although the example in which the object other than a face is anillustration image or an image for superimposition has been describedhitherto, the object may be a natural object such as a vegetable or anartificial object such as a clock.

Although the example in which a face model is connected to an objectimage in advance has been described hitherto, the information processingapparatus 100-1 may synthesize a model of an object that is generatedfrom an object image. For example, the control unit 108 may synthesize atomato model generated from a tomato image with another tomato model.

Furthermore, the control unit 108 may perform synthesis between modelsof different objects. For example, the control unit 108 performssynthesis of a face model generated from a face image with a tomatomodel generated from a tomato image. Since how to pick up the featurepoints and the numbers of the feature points are different between theface model and the tomato model in this case, mesh information andtexture information are different. Therefore, the feature points, themesh information, and the texture information are associated between themodels in advance.

According to the ninth modification example of the embodiment, theinformation processing apparatus 100-1 performs synthesis in which atleast one of models of src and dst is a model of an object other than aface as described above. Therefore, since application destinations ofthe synthesis processing are expanded to objects other than the face, itis possible to address various user's needs.

Tenth Modification Example

According to the tenth modification example of the embodiment, asynthesized face mask may be superimposed and displayed regardless of auser's operation. Specifically, if a predetermined time elapses afterthe face recognition, the control unit 108 performs synthesis of a facemask generated from a face image related to face recognition with apredetermined face mask and causes the synthesized face mask obtained bythe synthesis to be superimposed and displayed on the face image.

The face mask to be synthesized may be moved toward the face imagerelated to the recognized face. In a case in which a user's face isdisplayed on the screen, for example, and a predetermined time elapsesafter recognition of the user's face, a face mask or the like to be usedfor synthesis is moved toward the recognized user's face, that is, aface image on the screen as if the face mask or the like flew to theuser's face. Then, if the moved face mask reaches the user's face, thesynthesized face mask is superimposed and displayed on the user's face.In a case in which the moved face mask does not reach the user's face,the synthesis is not performed.

The face mask to be synthesized may be moved as if the face mask wascarried by a display object displayed on the screen. For example, acharacter holds the face mask and moves, and if the character moves tothe user's face, the synthesized face mask is superimposed and displayedon the user's face.

In a case in which the number of the face masks or the like that serveas dst is a predetermined number, synthesis of face masks correspondingto the predetermined number with the face masks that serve as dst may beperformed. In a case in which seven faces are present on the screen, forexample, face masks of a face mask group corresponding to seven, forexample, face masks of faces of seven comic heroes and the face masks ofthe seven faces on the screen are respectively associated andsynthesized with each other, and seven synthesized face masks obtainedby the synthesis are respectively superimposed and displayed on theseven faces on the screen.

According to the tenth modification example of the embodiment, thesynthesized face mask is superimposed and displayed regardless of auser's operation as described above. Therefore, the user does not needto perform the operation, and it is possible to omit time and efforts ofthe user. Also, the convenience for the user is improved in a case inwhich it is difficult for the user to perform the operation.

2. Second Embodiment (Application Example to Digital Signage Apparatus)

The information processing apparatus 100-1 according to the firstembodiment of the present disclosure has been described hitherto. Next,an information processing apparatus 100-2 according to a secondembodiment of the present disclosure will be described. The informationprocessing apparatus 100-2 according to the embodiment is a stationaryapparatus such as a digital signage.

2-1. Configuration of Apparatus

Since a functional configuration of the information processing apparatus100-2 according to the second embodiment of the present disclosure issubstantially the same as the functional configuration of theinformation processing apparatus 100-1 according to the firstembodiment, the description will be omitted.

2-2. Technical Features of Apparatus

Next, technical features of the information processing apparatus 100-2according to the embodiment will be described. Descriptions ofsubstantially the same features as those in the first embodiment will beomitted.

(G. Assignment of Target of Synthesis)

The information processing apparatus 100-1 assigns a target of synthesisin accordance with a user's gesture operation as an input based onuser's motion.

(G-1. Assignment of Target of Synthesis Based on Movement of Face Mask)

The control unit 108 causes a face mask of the target of synthesis to bemoved in response to the user's gesture operation. Furthermore,processing of moving the face mask in response to the gesture operationwill be described with reference to FIG. 21. FIG. 21 is a diagramillustrating an operation of moving a face mask of a target of synthesisin the information processing apparatus 100-2 according to theembodiment.

First, the control unit 108 causes a face mask or the like as a targetof synthesis to be displayed. For example, the control unit 108 causes aface list in which face masks or the like that serve as src are lined upto be displayed as shown in the left diagram in FIG. 21.

Then, the control unit 108 causes a face mask or the like to be moved inresponse to a user's gesture of selecting the face mask or the like fromthe face list. If the user acts to pick up a face image 12N from theface list as shown in the center diagram in FIG. 21, for example, thecontrol unit 108 causes the face image 12N to be moved in response tothe user's action.

Next, if the face mask or the like is moved to the user's face, thecontrol unit 108 causes a synthesized face mask to be superimposed anddisplayed on the user's face. If the face image 12N is moved to theuser's face, for example, the control unit 108 causes a synthesized facemask 36N obtained by the synthesis of the face mask of the face image12N and the face mask of the user's face to be superimposed anddisplayed on the user's face as shown in the right diagram in FIG. 21.

(G-2. Assignment of Target of Synthesis Based on User's Movement)

Also, the control unit 108 may assign a target of synthesis on the basisof user's movement. Processing of this configuration will be describedin detail with reference to FIG. 22. FIG. 22 is a diagram illustratingprocessing of assigning a target of synthesis on the basis of user'smovement in the information processing apparatus 100-2 according to theembodiment. Description of substantially the same functions as theaforementioned functions will be omitted.

First, the control unit 108 causes a face mask as a target of synthesisto be displayed as described above.

If the user's face and the face mask are overlapped by the user'smovement, then the control unit 108 causes the synthesized face mask tobe superimposed and displayed on the user's face. If the user's face isoverlapped with a face image 12 lined up in the face list as shown inthe center diagram in FIG. 22, for example, the control unit 108 causesa synthesized face mask 36O obtained by the synthesis of a face mask ofa face image 12O with a face mask of the user's face to be superimposedand displayed on the user's face as shown in the right diagram in FIG.22.

2-3. Processing by Apparatus

Since processing by the information processing apparatus 100-2 accordingto the second embodiment of the present disclosure is substantially thesame as the processing by the information processing apparatus 100-1according to the first embodiment, description thereof will be omitted.

2-4. Summary of Second Embodiment

According to the second embodiment of the present disclosure, an inputbased on user's motion includes a gesture operation, and the informationprocessing apparatus 100-2 causes a face mask to be moved, forsynthesis, on the basis of the gesture operation as described above.Therefore, the user can sensually perform the operation for synthesis,and the operability in the operation related to the synthesis can beimproved.

2-5. Modification Examples

The second embodiment of the present disclosure has been describedhitherto. The embodiment is not limited to the aforementioned example.Hereinafter, first and second modification examples of the embodimentwill be described.

First Modification Example

According to the first modification example of the embodiment, asynthesized face mask may be superimposed and displayed regardless of auser's operation. Specifically, the control unit 108 causes a face maskof a target of synthesis to be moved as if the face mask was carried bya display object displayed on the screen. Furthermore, processingaccording to the modification example will be described in detail withreference to FIG. 23. FIG. 23 is a diagram illustrating an example inwhich a face mask or the like as a target of synthesis is moved by acharacter according to the first modification example of the embodiment.

The control unit 108 causes a display object that is accompanied by aface mask to be moved toward a user's face that appears on the screen. Acharacter 70 that holds a face mask 22P moves toward the user's face onthe screen as shown in the left diagram in FIG. 23, for example.

Next, if the display object that is accompanied by the face mask reachesthe vicinity of the user's face that appears on the screen, the controlunit 108 causes the face mask to be moved from the display object to theuser's face. If the character 70 moves to the vicinity of the user'sface, the character 70 through the face mask 22P that the character 70holds toward the user's face as shown in the center diagram in FIG. 23,for example.

Next, if the face mask reaches the user's face that appears on thescreen, the control unit 108 causes a synthesized face mask to besuperimposed and displayed on the user's face. If the face mask 22Preaches the user's face as shown in the right diagram in FIG. 23, forexample, a synthesized face mask 36P that is obtained by synthesis ofthe face mask 22P with the face mask of the user's face is superimposedand displayed on the user's face.

According to the first modification example of the embodiment, theinformation processing apparatus 100-2 causes the face mask of thetarget of synthesis to be moved as if the face mask was carried by thedisplay object displayed on the screen. Therefore, it is possible toimprove attraction of the user to the processing of synthesizing theface mask by allowing the user to enjoy the process before the synthesisis performed.

Second Modification Example

According to the second modification example of the embodiment, theinformation processing apparatus 100-2 may perform synthesis inaccordance with a link of a target of synthesis. Specifically, thecontrol unit 108 links the target of synthesis on the basis of a user'sselection operation and performs synthesis on the basis of the linkedtarget of synthesis. If the user selects a target of synthesis, forexample, a face mask or the like that serves as dst, for example, andimages his or her own face, for example, the control unit 108 generatesa face mask of the user's face and links the selected face mask or thelike with the face mask of the user. Then, the control unit 108 performssynthesis on the basis of the face mask or the like linked with theuser's face mask and causes the generated synthesized face mask to besuperimposed and displayed on the image in which the user's faceappears.

One or both targets of synthesis may be selected on the face list. Also,a plurality of links may be provided, and in such a case, the user mayselect which of the links is to be used. For example, the user selects alink through a mobile terminal such as a smartphone or a tabletterminal, information about the selected link (hereinafter, alsoreferred to as link information) is provided to the informationprocessing apparatus 100-2 such as a digital signage, and theinformation processing apparatus 100-2 displays the synthesized facemask in accordance with the provided link information.

The link information of the target of synthesis may be shared withanother apparatus. Specifically, the control unit 108 provides the linkinformation to another information processing apparatus viacommunication. Furthermore, the sharing of the link information will bedescribed in detail with reference to FIG. 24. FIG. 24 is a diagramillustrating generation and sharing of link information according to thesecond modification example of the embodiment.

The control unit 108 generates link information of a target of synthesison the basis of a user's selection and shares the generated linkinformation. For example, a face appearing position of a comicforeground 200 and a face mask of a character at the face appearingposition are associated with each other in advance as shown in the leftdiagram in FIG. 24. The user selects a face that the user desires tocause to link, fit his or her face to the face appearing hole of a facethat the user desires to cause to link, and images the comic foreground200 in the state in which the face is fitted thereto. If an imageobtained by the image capturing is provided to the informationprocessing apparatus 100-2 via communication, then the control unit 108generates a face mask of the user's face that is fitted thereto. Then,the control unit 108 generates link information of the generated facemask and the face mask associated with the face appearing position ofthe comic foreground 200. Then, the control unit 108 provides the linkinformation to another information processing apparatus 100-2 viacommunication.

If the link information is provided, the control unit 108 stores thelink information. If the link information is received, for example, thecontrol unit 108 causes the storage unit 110 to store the linkinformation.

Next, if the face corresponding to the face mask that matches the linkinformation is recognized in the image obtained by the image capturing,the control unit 108 generates a face mask of the recognized face andsuperimposes and displays the synthesized face mask on the basis of theface mask and the linked face mask. If the user related to the storedlink information enters an imaging range, and the user's face isrecognized, for example, the control unit 108 generates the face mask ofthe user's face. Then, the control unit 108 causes synthesized facemasks 34Q1 and 34Q2 obtained by the synthesis of the generated face maskand the linked face mask to be superimposed and displayed on characterface images corresponding to the linked face masks, respectively.

Although the example in which the physical comic foreground 200 is usedhas been described hitherto, a virtual foreground to be displayed on thedigital signage may be used.

The information processing apparatus that images the comic foregroundmay be the information processing apparatus 100-1 according to the firstembodiment. In such a case, the information processing apparatus 100-1that performs the image capturing generates the link information, andthe information processing apparatus 100-1 provides the linkinformation.

According to the second modification example of the embodiment, theinformation processing apparatus 100-2 links the target of synthesis onthe basis of the user's selection operation and performs synthesis onthe basis of the linked target of synthesis. Therefore, since the targetof synthesis is managed by the linking, it becomes easy to store thecombination of targets of synthesis and to recombine the targets ofsynthesis.

The link information is shared with another apparatus. Therefore, sincethe synthesized face mask is also displayed on another apparatus inaccordance with the linking, it is possible to omit time and effortsrequired for setting the target of synthesis for each apparatus and toimprove the convenience for the user.

3. Application Examples

The configurations described in the aforementioned respectiveembodiments can be applied to various cases. Hereinafter, a part of thecases other than the aforementioned respective embodiments will bedescribed.

(Protection of Privacy)

It is possible to protect privacy by causing a synthesized face mask tobe superimposed and displayed on a face of a person that appears in animage. For example, the information processing apparatus 100 generatesthe synthesized face mask on the basis of mesh information of dst andtexture information of src by using the face mask of the person whoappears in the image as dst and the separately selected face mask assrc. Then, the information processing apparatus 100 causes the generatedface mask to be superimposed and displayed on the face of the person whoappears in the image that serves as dst.

The face mask that serves as src is superimposed and displayed on a faceimage corresponding to the face mask that serves as dst. In such a case,the face that appears in the image looks like a face covered with afacial mask.

(Movie of Karaoke)

It is possible to boost feeling of a person who sings a song withkaraoke play or feeling of a person who listens to it by causing asynthesized face mask to be superimposed and displayed on a face of aperson who appears in a movie displayed on karaoke. For example, theinformation processing apparatus 100 generates the synthesized face maskon the basis of mesh information of dst and texture information of srcby using the face mask of the person who appears in the movie of thekaraoke as dst and the face mask of the person who sings a song as src.Then, the information processing apparatus 100 causes the generatedsynthesized face mask to be superimposed and displayed on the face ofthe person who appears in the movie of the karaoke. The synthesized facemask may be generated on the basis of texture information of src andtexture information of dst in an opposite manner.

Synthesis may be performed between faces of persons who appear in thekaraoke movie. For example, the information processing apparatus 100causes a synthesized face mask obtained by synthesis of a face mask of aface of a person X with a face mask of a face of another person Y whoappears on the karaoke movie to be superimposed and displayed on theface of the person X who appears in the movie of the karaoke.

(Movie of Video Chatting)

By causing a synthesized face mask to be superimposed and displayed on aface of a person who appears in a movie of video chatting, it ispossible to smoothen communication through the video chatting. Forexample, the information processing apparatus 100 causes a synthesizedface mask obtained by synthesizing an eye part of a face mask of aperson who appears in a movie of video chatting with eyes that look at acamera for the video chatting to be superimposed and displayed on theperson. In this manner, the line of sight of the person who appears inthe movie of the video chatting is displayed as if it was directed tothe camera.

(Embedding of Face Feature Information in Medium)

It is possible to cause a synthesized face mask to be superimposed anddisplayed on a face that appears in an image even in a case in which itis difficult to directly generate a face mask from the image related toa medium, by connecting face feature information to the medium inadvance. For example, the medium is a moving image, and face featureinformation or feature point information connected to each frame of themoving image is stored in moving image information as meta-information.Then, the information processing apparatus 100 performs synthesis byusing face feature information or the like that is stored as movingimage information of the moving image when the moving image isreproduced. The face feature information or the like may be connected toa part of frames of the moving image. The information stored as themoving image information may be feature point information and colorinformation related to feature points.

The medium may be paper such as a magazine, a book, or a newspaper. Forexample, readable face feature information such as a two-dimensional ARmarker is written in advance near a person who is posted in a magazine.If the user images the two-dimensional AR marker, then the informationprocessing apparatus 100 generates a face mask on the basis of the facefeature information read from the two-dimensional AR marker and performssynthesis by using the generated face mask.

4. Hardware Configuration of Information Processing Apparatus Accordingto One Embodiment of Present Disclosure

FIG. 25 is an explanatory diagram that illustrates a hardwareconfiguration of the information processing apparatus 100 according toan embodiment of the present disclosure. As illustrated in FIG. 25, theinformation processing apparatus 100 includes a central processing unit(CPU) 142, a read only memory (ROM) 144, a random access memory (RAM)146, a bridge 148, a bus 150, an interface 152, an input device 154, anoutput device 156, a storage device 158, a drive 160, a connection port162, and a communication device 164.

The CPU 142 functions as a computation processing device, and cooperateswith various types of programs to achieve the operation of the facerecognition unit 104, the operation detection unit 106, and the controlunit 108 in the information processing apparatus 100. Also, the CPU 142may be a microprocessor. The ROM 144 stores programs, calculationparameters, or the like, used by the CPU 142. The RAM 146 temporarilystores the programs used in the execution of the CPU 142 or theparameters that change as appropriate in the execution, for example. TheROM 144 and the RAM 146 constitute a part of the storage unit 110 in theinformation processing apparatus 100. The CPU 142, the ROM 144, and theRAM 146 are connected to each other via an internal bus configured witha CPU bus or the like.

For example, as examples of the imaging unit 102 in the informationprocessing apparatus 100, the input device 154 is configured with aninput means for the user to input information, such as a mouse, akeyboard, a touch panel, a button, a microphone, a switch, and a lever,and an input control circuit that generates an input signal on the basisof an input by a user and outputs the input signal to the CPU 142, forexample. The user of the information processing apparatus 100 can inputvarious types of data to the information processing apparatus 100 andinstruct the processing operation, by operating the input device 154.

For example, as an example of the display unit 112 in the informationprocessing apparatus 100, the output device 156 performs outputting to adevice such as a liquid crystal display (LCD) device, an organic lightemitting diode (OLED) device, and a lamp, for example. Further, theoutput device 156 may perform sound outputting of a speaker, aheadphone, and the like.

The storage device 158 is a device for data storage. The storage device158 may include a storage medium, a record device that records data inthe storage medium, a reading device that reads out data from thestorage medium, a deleting device that deletes the data recorded in thestorage medium, and the like. The storage device 158 stores the programsexecuted by the CPU 142 and various types of data.

The drive 160 is a reader/writer for the storage medium, and is providedinside or externally attached to the information processing apparatus100. The drive 160 reads out the information recorded in a removablestorage medium, such as a magnetic disk, an optical disc, amagneto-optical disk, or a semiconductor memory, which is put in thedrive 160, and outputs the information to the RAM 134. Also, the drive160 can write information into the removable storage medium.

The connection port 162 is a bus for connecting to an informationprocessing apparatus or a peripheral device outside the informationprocessing apparatus 100, for example. Also, the connection port 162 maybe a universal serial bus (USB).

The communication device 164 is a communication interface configuredwith a communication device for connecting to a network, for example.Also, the communication device 164 may be an infrared communicationcompliant device, may be a wireless local area network (LAN) compatiblecommunication device, may be a long term evolution (LTE) compatiblecommunication device, or may be a wired communication device thatperforms wired communication.

5. Conclusion

According to the first embodiment of the present disclosure, it ispossible to perform synthesis that is desirable for the user byperforming the synthesis in accordance with input information asdescribed above. It is possible to improve the operational feeling forthe synthesis by moving the face mask in accordance with intentions ofthe user.

According to the second embodiment of the present disclosure, the usercan sensually perform operations for synthesis, and operability of theoperations related to the synthesis can be improved.

The preferred embodiment(s) of the present disclosure has/have beendescribed above with reference to the accompanying drawings, whilst thepresent disclosure is not limited to the above examples. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.

Although face masks or the like as targets of synthesis are displayed onthe same screen in the aforementioned embodiments, the presenttechnology is not limited to such an example. For example, the facemasks or the like as the targets of synthesis may be respectivelydisplayed on different screens. For example, a user selects a face maskor the like that serves as src by a mobile terminal such as asmartphone, and causes the selected face mask or the like to be movedtoward a device such as a digital signage on which a face mask or thelike that serves as dst is displayed, by a swiping operation, forexample. As a result, the face mask that serves as src is provided fromthe smartphone to the digital signage via communication, and thesynthesized face mask obtained by synthesis using the provided face maskis superimposed and displayed on the face of dst displayed by thedigital signage.

Although the example in which synthesis is performed on the entire facehas been described in the aforementioned embodiments, the synthesis maybe performed on a part of the face. For example, the synthesis isperformed only on a part of the face, such as eyes, a nose, a mouth, oreyebrows.

Although the example in which the display unit 112 is a display has beendescribed in the aforementioned embodiments, the display unit 112 may bea projector. For example, the control unit 108 causes a synthesized facemask to be projected to the display unit 112 toward the facecorresponding to the face mask that serves as dst.

Although the example in which the main target of synthesis if a facemask has been described in the aforementioned embodiments, the target ofsynthesis may be a mask of a head. For example, the informationprocessing apparatus 100 may generate a model for the entire head, thatis, a head mask and performs synthesis of the generated head mask.

Although the example in which the information processing apparatus 100is a smartphone, a tablet terminal, or a digital signage has beendescribed in the aforementioned embodiments, the information processingapparatus 100 may be a head mount display (HMD) of a so-called opticalsee-through type or a video see-through type or a personal computer(PC).

The information processing apparatus 100 may cause the synthesized facemask to be changed on the basis of position information of a personrelated to the face mask or the like that serves as src. Specifically,the information processing apparatus 100 causes the synthesized facemask to be changed in accordance with a distance between the positionindicated by the position information and a specific position. Forexample, the information processing apparatus 100 causes face featureinformation of a synthesized face mask, which is obtained bysynthesizing a face mask of a face of a user with a face mask of a faceof an artist in a live concert, to further approach face featureinformation of the face mask of the artist as the user approaches themusic live concert hall. In a case in which the information processingapparatus 100 is a HMD, the synthesized face mask is superimposed anddisplayed on persons around the user. It is a matter of course that thesynthesized face mask may be superimposed and displayed on the face ofthe artist. In such a case, it is possible to provide a fan to the usereven in a process of visiting to a specific position such as a liveconcert hall.

The information processing apparatus 100 may cause the synthesized facemask to be changed in accordance with whether the position indicated bythe position information is within a specific range. For example, in acase in which the user is in a theme park, the information processingapparatus 100 causes a synthesized face mask obtained by synthesizingface masks of other persons in the theme park and a face mask of a faceof the user on the faces of the other persons to be superimposed anddisplayed. If the user leaves the theme park, the information processingapparatus 100 stops the superimposition and display of the synthesizedface mask. In such a case, it is possible to improve a realisticsensation in the specific region such as a theme park.

Although some application examples have been described hitherto, it is amatter of course that the configurations of the respective embodimentsof the present disclosure may be applied to other fields, businesscategories, products, applications, or the like. For example, theconfigurations may be applied to the field of cosmetic surgery. In sucha case, a face after surgery is superimposed as a synthesized face maskon a user's face, for example.

Further, the effects described in this specification are merelyillustrative or exemplified effects, and are not limitative. That is,with or in the place of the above effects, the technology according tothe present disclosure may achieve other effects that are clear to thoseskilled in the art from the description of this specification.

Further, not only a process in which steps shown in the flowcharts ofthe above embodiments are performed in a time-series manner inaccordance with a described sequence but also a process in which thesteps are not necessarily processed in a time-series manner but areexecuted in parallel or individually is included. Also, it isself-evident that even steps processed in a time-series manner can beappropriately changed in sequence depending on circumstances.

Additionally, the present technology may also be configured as below.

(1)

-   -   An information processing apparatus including:    -   a control unit configured to        -   generate a synthesized object model by synthesizing a first            object model and a second object model, and        -   cause the generated synthesized object model to be displayed            in association with an image corresponding to the first            object model or the second object model,    -   in which the control unit controls a mode of the synthesis on        the basis of input information.        (2)    -   The information processing apparatus according to (1),    -   in which the first object model includes a first face model,    -   the second object model includes a second face model, and    -   the synthesized object model includes a synthesized face model.        (3)    -   The information processing apparatus according to (2),    -   in which the mode includes a first mode in which the synthesized        face model is generated on the basis of mesh information of the        first face model, and a second mode in which the synthesized        face model is generated on the basis of mesh information of the        second face model.        (4)    -   The information processing apparatus according to (3),    -   in which, in the first mode, the synthesized face model is        generated on the basis of texture information of the second face        model, and    -   in the second mode, the synthesized face model is generated on        the basis of texture information of the first face model.        (5)    -   The information processing apparatus according to any one of (2)        to (4),    -   in which face feature information includes mesh information and        texture information of a face model, and    -   the mode includes a third mode in which the synthesized face        model is generated on the basis of the mesh information of the        first face model, the mesh information of the second face model,        the texture information of the first face model, and the texture        information of the second face model.        (6)    -   The information processing apparatus according to any one of (2)        to (5),    -   in which the control unit causes the synthesized face model to        be displayed in association with an image specified on the basis        of a user's input from among images corresponding to the first        face model and the second face model.        (7)    -   The information processing apparatus according to any one of (2)        to (6),    -   in which the input information includes information related to        an image corresponding to the first face model or the second        face model that serves as an input of processing performed by        the control unit.        (8)    -   The information processing apparatus according to (7),    -   in which the information related to the image includes        information related to an attribute of the image or content of        the image.        (9)    -   The information processing apparatus according to any one of (2)        to (8),    -   in which the input information includes information related to a        user's input operation.        (10)    -   The information processing apparatus according to (9),    -   in which the user's input operation includes an operation of        selecting the first face model or the second face model, and    -   the control unit assigns the mode in accordance with a selected        position of the first face model or the second face model.        (11)    -   The information processing apparatus according to (10),    -   in which the control unit causes the selected position of the        first face model or the second face model corresponding to each        of the modes to be displayed in a visually distinguishable form.        (12)    -   The information processing apparatus according to any one of (2)        to (11),    -   in which the control unit uses face feature information of        another face model in a case in which face feature information        for generating the synthesized face model is insufficient.        (13)    -   The information processing apparatus according to (12),    -   in which the other face model includes a past face model, or the        first face model or the second face model serving as a        counterpart of the synthesis.        (14)    -   The information processing apparatus according to any one of (2)        to (13),    -   in which the control unit changes the face feature information        of the synthesized face model on the basis of the input        information.        (15)    -   The information processing apparatus according to (14),    -   in which the control unit changes face feature information of        the synthesized face model between face feature information of        the first face model and face feature information of the second        face model on the basis of a user's input operation.        (16)    -   The information processing apparatus according to (14) or (15),    -   in which the control unit changes mesh information of the        synthesized face model on the basis of attribute information of        the first face model or the second face model.        (17)    -   The information processing apparatus according to any one        of (14) to (16),    -   in which the control unit changes texture information of the        synthesized face model on the basis of the first face model, the        second face model, or an image with which the synthesized face        model is associated.        (18)    -   The information processing apparatus according to any one of (2)        to (17),    -   in which at least one of images corresponding to the first face        model and the second face model includes an image that is        temporarily recorded by imaging.        (19)    -   An information processing method including: by a control unit,    -   generating a synthesized object model by synthesizing a first        object model and a second object model;    -   causing the generated synthesized object model to be displayed        in association with an image corresponding to the first object        model or the second object model; and    -   controlling a mode of the synthesis on the basis of input        information.        (20)    -   A program that causes a computer to realize:    -   a function of generating a synthesized object model by        synthesizing a first object model and a second object model;    -   a function of causing the generated synthesized object model to        be displayed in association with an image corresponding to the        first object model or the second object model; and    -   a function of controlling a mode of the synthesis on the basis        of input information.

Additionally, the present technology may also be configured as below.

(1)

-   -   An information processing apparatus including:    -   a control unit configured to        -   generate a synthesized object model by synthesizing a first            object model and a second object model, and    -   cause the generated synthesized object model to be displayed in        association with an image corresponding to the first object        model or the second object model,    -   in which the control unit causes the first object model or the        second object model to be moved, for the synthesis, in response        to an input based on a user's motion with respect to a screen on        which an object model or an image corresponding to the object        model is displayed.        (2)    -   The information processing apparatus according to (1),    -   in which the first object model includes a first face model,    -   the second object model includes a second face model, and    -   the synthesized object model includes a synthesized face model.        (3)    -   The information processing apparatus according to (2),    -   in which, after movement from one of the first face model and        the second face model to the other is completed, the control        unit causes the synthesized face model to be displayed in        association with the image corresponding to the other face        model.        (4)    -   The information processing apparatus according to (2) or (3),    -   in which, when the input based on the user's motion is        interrupted, the control unit does not perform the synthesis.        (5)    -   The information processing apparatus according to any one of (2)        to (4),    -   in which the input based on the user's motion includes an        operation of assigning both a start point and an end point or an        operation of assigning only the start point.        (6)    -   The information processing apparatus according to any one of (2)        to (5),    -   in which the input based on the user's motion includes a gesture        operation.        (7)    -   The information processing apparatus according to any one of (2)        to (6),    -   in which the control unit causes the first face model or the        second face model corresponding to the image associated with the        synthesized face model to be displayed to be adjacent to the        synthesized face model when the synthesized face model is        displayed.        (8)    -   The information processing apparatus according to any one of (2)        to (7),    -   in which the first face model or the second face model to be        moved includes a face model that is lined up in a face list        displayed on the screen or a face model that is generated from        an image lined up in the face list.        (9)    -   The information processing apparatus according to (8),    -   in which the control unit selects a face model or an image lined        up in the face list on the basis of an attribute of a face that        is expressed by the first face model or the second face model.        (10)    -   The information processing apparatus according to (8) or (9),    -   in which the control unit adds the first face model or the        second face model moved toward the face list to the face list.        (11)    -   The information processing apparatus according to any one of (8)        to (10),    -   in which the control unit performs prior display of a second        synthesized face model related to the synthesized face model.        (12)    -   The information processing apparatus according to (11),    -   in which the prior display of the second synthesized face model        includes causing the first face model or the second face model,        which is being moved, to be changed into the second synthesized        face model.        (13)    -   The information processing apparatus according to (12),    -   in which the second synthesized face model includes a        synthesized face mask in which face feature information of the        synthesized face model is changed in accordance with information        related to the movement of the first face model or the second        face model, which is being moved.        (14)    -   The information processing apparatus according to any one        of (11) to (13),    -   in which the prior display of the second synthesized face model        includes causing a face model that is lined up in the face list        or a face model that is generated from an image lined up in the        face list, to be changed into the second synthesized face model.        (15)    -   The information processing apparatus according to (14),    -   in which the control unit causes a face model selected from or        all the face models from among face models lined up in the face        list or face models that are generated from images lined up in        the face list, to be changed into the second synthesized face        model.        (16)    -   The information processing apparatus according to any one of (2)        to (15),    -   in which, in a case in which a plurality of face models or        images corresponding to the face models are displayed on the        screen, the control unit generates the respective synthesized        face models on the basis of a moved face model and the plurality        of face models or the images corresponding to the face models.        (17)    -   The information processing apparatus according to (16),    -   in which, when a face model is moved to one of the plurality of        face models or one of the images corresponding to the face        models, the control unit performs the synthesis.        (18)    -   The information processing apparatus according to any one of (2)        to (17),    -   in which at least one of the first face model and the second        face model includes a face model of the user.        (19)    -   An information processing method including: by a control unit,    -   generating a synthesized object model by synthesizing a first        object model and a second object model;    -   causing the generated synthesized object model to be displayed        in association with an image corresponding to the first object        model or the second object model; and    -   causing the first object model or the second object model to be        moved, for the synthesis, in response to an input based on a        user's motion with respect to a screen on which an object model        or an image corresponding to the object model is displayed.        (20)    -   A program that causes a computer to realize:    -   a function of generating a synthesized object model by        synthesizing a first object model and a second object model;    -   a function of causing the generated synthesized object model to        be displayed in association with an image corresponding to the        first object model or the second object model; and    -   a function of causing the first object model or the second        object model to be moved, for the synthesis, in response to an        input based on a user's motion with respect to a screen on which        an object model or an image corresponding to the object model is        displayed.

REFERENCE SIGNS LIST

-   100 information processing apparatus-   102 imaging unit-   104 face recognition unit-   106 operation detection unit-   108 control unit-   110 storage unit-   112 display unit

1. An information processing apparatus comprising: a control unitconfigured to generate a synthesized object model by synthesizing afirst object model and a second object model, and cause the generatedsynthesized object model to be displayed in association with an imagecorresponding to the first object model or the second object model,wherein the control unit controls a mode of the synthesis on a basis ofinput information.
 2. The information processing apparatus according toclaim 1, wherein the first object model includes a first face model, thesecond object model includes a second face model, and the synthesizedobject model includes a synthesized face model.
 3. The informationprocessing apparatus according to claim 2, wherein the mode includes afirst mode in which the synthesized face model is generated on a basisof mesh information of the first face model, and a second mode in whichthe synthesized face model is generated on a basis of mesh informationof the second face model.
 4. The information processing apparatusaccording to claim 3, wherein, in the first mode, the synthesized facemodel is generated on a basis of texture information of the second facemodel, and in the second mode, the synthesized face model is generatedon a basis of texture information of the first face model.
 5. Theinformation processing apparatus according to claim 2, wherein facefeature information includes mesh information and texture information ofa face model, and the mode includes a third mode in which thesynthesized face model is generated on a basis of the mesh informationof the first face model, the mesh information of the second face model,the texture information of the first face model, and the textureinformation of the second face model.
 6. The information processingapparatus according to claim 2, wherein the control unit causes thesynthesized face model to be displayed in association with an imagespecified on a basis of a user's input from among images correspondingto the first face model and the second face model.
 7. The informationprocessing apparatus according to claim 2, wherein the input informationincludes information related to an image corresponding to the first facemodel or the second face model that serves as an input of processingperformed by the control unit.
 8. The information processing apparatusaccording to claim 7, wherein the information related to the imageincludes information related to an attribute of the image or content ofthe image.
 9. The information processing apparatus according to claim 2,wherein the input information includes information related to a user'sinput operation.
 10. The information processing apparatus according toclaim 9, wherein the user's input operation includes an operation ofselecting the first face model or the second face model, and the controlunit assigns the mode in accordance with a selected position of thefirst face model or the second face model.
 11. The informationprocessing apparatus according to claim 10, wherein the control unitcauses the selected position of the first face model or the second facemodel corresponding to each of the modes to be displayed in a visuallydistinguishable form.
 12. The information processing apparatus accordingto claim 2, wherein the control unit uses face feature information ofanother face model in a case in which face feature information forgenerating the synthesized face model is insufficient.
 13. Theinformation processing apparatus according to claim 12, wherein theother face model includes a past face model, or the first face model orthe second face model serving as a counterpart of the synthesis.
 14. Theinformation processing apparatus according to claim 2, wherein thecontrol unit changes the face feature information of the synthesizedface model on the basis of the input information.
 15. The informationprocessing apparatus according to claim 14, wherein the control unitchanges face feature information of the synthesized face model betweenface feature information of the first face model and face featureinformation of the second face model on a basis of a user's inputoperation.
 16. The information processing apparatus according to claim14, wherein the control unit changes mesh information of the synthesizedface model on a basis of attribute information of the first face modelor the second face model.
 17. The information processing apparatusaccording to claim 14, wherein the control unit changes textureinformation of the synthesized face model on a basis of the first facemodel, the second face model, or an image with which the synthesizedface model is associated.
 18. The information processing apparatusaccording to claim 2, wherein at least one of images corresponding tothe first face model and the second face model includes an image that istemporarily recorded by imaging.
 19. An information processing methodcomprising: by a control unit, generating a synthesized object model bysynthesizing a first object model and a second object model; causing thegenerated synthesized object model to be displayed in association withan image corresponding to the first object model or the second objectmodel; and controlling a mode of the synthesis on a basis of inputinformation.
 20. A program that causes a computer to realize: a functionof generating a synthesized object model by synthesizing a first objectmodel and a second object model; a function of causing the generatedsynthesized object model to be displayed in association with an imagecorresponding to the first object model or the second object model; anda function of controlling a mode of the synthesis on a basis of inputinformation.